H.f.T.  LIBRARIES  -  DB'^^EY 


D28  _. 

M414  Dewey 


9 


Identifying  Significant  Design  Factors  in 
Robost  Product  Designs 


oy 
Yue  Fang 
Bin  Ziiou 


WP  #  3723  September  1994 


;.;agsachusetts  livisriTure 

OF  TECHNOLOGY 

DEC  01 1994 

LIBRARIES 


Identifying  Significant  Design  Factors  In 
Robust  Product  Designs 

Yue  Fang  and  Bin  Zhou* 
Sloan  School  of  Management,  MIT,  Cambridge,  MA  02139 

September  1,  1994 

Abstract 

In  the  screening  phase  of  robust  product  design,  investigators  often  need 
to  identify  most  significant  design  factors  among  a  large  number  of  candi- 
dates. The  significant  design  factors  considered  to  be  further  investigated 
include  those  which  either  have  significant  main  effects  or(and)  are  impor- 
tant to  eliminate  variation  due  to  uncontrollable  environmental  conditions. 
The  significance  of  main  effects  of  design  factors  demonstrate  the  contri- 
butions of  the  factor  effects  to  the  system  response.  The  significance  of 
design X  environment  interactions  provide  a  measure  of  the  robustness  of  de- 
sign factors  to  environmental  conditions. 

In  this  paper  we  focus  on  estimating  main  effects  of  design  factors  and 
design  X environment  interactions.  We  assume  that  there  may  be  some  signif- 
icant design X design  and  environment  x  environment  interactions.  However, 
we  assume,  as  is  often  realistic,  that  all  three  or  higher  order  interactions 
are  negligible.  We  develop  block  cross-array  strategy  to  construct  a  series  of 
desired  designs.  Although  the  table  given  in  our  paper  provides  experiment 
designs  of  up  to  fifteen  design  factors  and  fifteen  environment  factors,  it  is 
easy  to  generalize  the  result  for  any  size  experiment  system.  The  proposed 
design  estimates  main  effects  of  design  factors  free  from  interactions  and  is 
superior  to  the  cross-array  design  recommended  by  Dr.  Taguchi. 


The  research  is  partially  sponsored  by  LFM  Program.  MIT  Sloan  School. 


1      Introduction 

1.1      Screening  Analysis  in  Robust  Design 

In  the  traditional  design  of  experiment  analysis,  screening  designs  are  usually 
high  fractional  factorial  designs.  They  are  used  for  studying  a  large  number 
of  design  factors^  at  the  initial  stage  of  experiment  investigation.  Plackett 
and  Burman  (1946)  (P-B  designs)  and  2"//  designs  are  typical  low  resolution 
designs  for  the  screening  purpose  (Box  and  Meyer  (1993);  Hamada  and  Wu 
(1992);  Dey  (1985);  Box  and  Meyer  (1985);  Box  and  Hunter  (1961)).  These 
resolution  III  designs  provide  unbiased  estimation  of  main  effects  only  when 
interactions  are  negligible.  When  some  two-factor  interactions  are  present, 
resolution  IV  designs  are  usually  used  to  estimate  main  effects.  The  design 
factors  with  relatively  significant  main  eti'ects  are  chosen  to  be  further  inves- 
tigated. 

In  the  context  of  robust  design,  there  is  one  more  objective  than  merely 
looking  for  design  factors  with  significant  main  effects.  The  general  idea  of 
robust  design  is  to  find  the  design  factors  which  bring  the  response  to  the  de- 
sired target  and  the  design  factors  which  influence  the  performance  measure 
and  can  be  used  to  minimize  the  variation  caused  by  environmental  sources. 
Therefore,  the  main  objective  is  to  select  design  factors  either  with  relatively 
significant  main  effects  and/or  sensitivity  to  the  uncontrollable  environment 
conditions. 

Signal-to-noise  ratio  (SN  ratio)  proposed  by  Taguchi  (1986)  is  one  of  the 
measures  used  to  study  the  robustness  of  design  factors  to  the  environment 
conditions.  The  significance  of  design  x  environment  interactions  is  another 
appropriate  measure.  We  will  use  the  latter  one  as  the  robustness  measure  in 
this  paper.  Some  detailed  discussions  about  the  measurement  of  robustness 
are  given  by  Nair  (1992),  Shoemaker.  Tsui  and  Wu  (1991).  Montgomery 
(1991).  Box  and  Jones  (1990).  Box  (1988).  Ryan  (1988)  and  Kackar  (1985). 


^Design  factors  refer  to  the  factors  which  are  controllable.  The  concept  only  has  mean- 
ing in  contrast  to  the  environment  factors,  which  are  hard-to-control  factors. 


1.2     Taguchi's  Orthogonal  Arrays 

In  robust  product  designs,  Taguchi  (Taguchi  (1986);  Taguchi  and  Phadke 
(1984);  Taguchi  and  Wu  (1980))  recommended  the  use  of  inner  and  outer 
orthogonal  arrays  to  find  the  design  factors  that  can  be  used  to  minimize 
the  effect  due  to  the  variation  caused  by  environmental  sources.  Most  of 
Taguchi's  inner  and  outer  arrays  are  two-,  three-  or  mixed-level  classic  frac- 
tional factorial  designs  (Kacker.  Lagergren  and  Filliben  (1990);  Box,  Bisgaard 
and  Fung  (1988)).  In  some  of  Taguchi's  designs,  the  inner  orthogonal  arrays 
are  highly  fractional  designs  with  complicated  confounding  structures,  while 
main  effects  of  design  factors  are  confounding  with  two-factor  interactions.  If 
some  interactions  among  design  factors  do  indeed  exist,  the  analysis  results 
often  are  confused  and  misleading  (Ryan  (1988);  Matar  and  Lochner  (1988); 
Hunter  (1985);  I-'ackar  (1985)).  A  fev  runs  of  a  follow-up  confirming  exper- 
iment is  often  recommended  in  practice  when  high  fractional  design  is  used. 
But  the  confirming  experiment  can  not  detect  significant  design  factors  that 
fail  to  be  found  in  the  first  place  (Logothetis  and  Wynn  (1989);  Lucas  (1989)). 

In  order  to  estimate  the  main  effects  of  design  factors  free  of  interactions, 
a  design  with  resolution  IV  or  higher  is  required  in  the  inner  array.  Because 
of  the  cross-array  arrangement,  the  total  number  of  experimental  runs  is  the 
product  of  the  size  of  inner  and  outer  arrays  in  Taguchi's  design.  For  a  sys- 
tem with  many  design  factors,  the  cross-array  arrangement  often  involves  a 
considerably  large  amount  of  experimental  work. 


1.3      Single  Orthogonal  Arrays 

Many  authors  (Shoemaker.  Tsui  and  Wu  (1991);  Montgomery  (1991);  Box 
and  Jones  (1990);  Welch.  Yu,  Kang  and  Sacks  (1990);  Bullington.  Hool  and 
Maghsoodloo  (1990);  Lucas  (1989):  Bisgaard  (1989);  Box.  Bisgaard  and  Fung 
(1988);  Nair  (1986))  suggested  the  use  of  a  single  array  instead  of  Taguchi's 
cross-array  in  robust  product  designs.  The  use  of  a  single  orthogonal  array 
may  reduce  the  experimental  runs  and  simplify  the  confounding  structure, 
especially  to  free  main  effects  of  design  factors  of  two-factor  interactions. 
The  single  array  is  based  on  traditional  fractional  factorial  designs.  It  is  con- 
structed by  choosing  the  design  generators  carefully  so  that  the  effects  which 


Table  1:  Tiy    Fractional  Factorial  Designs  (Example  1) 

Generator:  /  =  ABCDF  =  ABC  EG 
Aliases:  FG  =  DE 


are  desired  are  not  confounded. 

As  a  demonstration  example,  consider  an  experiment  with  four  design 
factors  and  three  environment  factors. 

Excunple  1:  Suppose  that  three  environment  factors  are  assigned  to  the 
letters  A,  B,  and  C. 'Design  factors  are  D,  E.  F,  and  G.  A  2'j^^  fractional 
factorial  design  is  given  in  Table  1.  The  design  requires  thirty- two  runs.  All 
main  effects  of  design  factors  and  design  x  environment  interactions  can  be 
estimated. 

The  single  array  experiment  plan  is  based  on  the  detailed  analysis  of  the 
confounding  structure  of  resolution  III  or  IV  fractional  factorial  designs.  An 
efficient  design  can  be  obtained  for  only  certain  combinations  of  the  numbers 
of  design  and  environment  factors.  More  detailed  discussions  are  given  by 
Box  and  Jones  (1990),  Addelman  (1962),  and  Whitwell  and  Morbey  (1961). 

In  the  following  sections,  we  use  an  alternative  approach  to  construct  de- 
signs providing  unbiased  estimates  of  effects  that  are  needed  to  identify  sig- 
nificant design  factors  in  the  screen  stage  of  the  robust  design  of  experiment. 
We  assume  that  there  may  be  some  significant  environment x environment 
and  design X design  interactions.  All  third  or  higher  order  interactions  are  as- 
sumed zeros.  The  objective  is  to  estimate  design x environment  interactions 
and  all  main  effects  of  design  factors.  We  first  investigate  the  general  esti- 
mation capacity  of  cross-array  design.  Then  we  introduce  block  cross-array 
technique  in  our  construction  to  reduce  the  required  number  of  runs.  The 
proposed  designs  are  illustrated  with  examples.  The  designs  are  tabulated  up 
to  fifteen  designs  and  fifteen  environment  factors.  The  generally  systematic 
construction  strategy  for  more  than  fifteen  design  or  environment  factors  is 
described.  A  discussion  is  addressed  in  the  last  section. 


Table  2:  Sixty-four-run  Cross-Array  Design  (Example  2) 

A  =  BD  =  CE  B  =  AD  =  CF  C  =  AE  =  BF 

D  =  AB  =  EF  E  =  AC  =  DF  F  =  BC  =  DE 
AF  =  BE  =  CD 

G  =  HK  =  JL  H  ^GK  =  JM       J  =  GL  =  HM 

K  =  GH  =  LM  L  =  GJ  =  KM  M  =  HJ  =  KL 
GM  ^HL  =  JK 


2     What  can  we  get  from  cross  orthogonal 
arrays? 

2.1      Example  for  Estimating  Design x  Environment  In- 
teractions 

Consider  an  example  with  six  design  factors  and  six  environment  factors. 

Example  2:  Denote  A,  B,  C,  D,  E  and  F  as  design  factors  and  G,  H. 
J,  K,  L.  and  M  as  environment  factors.  Suppose  that  we  use  2^7/  with  gen- 
erators /  =  ABD.  I  =  ACE  and  /  =  BCF  as  an  inner  array.  Use  2^//  with 
the  generator  /  =  GHK.  I  =  GJL  and  /  =  HJM  as  an  outer  array.  The 
confounding  relationship  of  the  cross-array  design  is  in  Table  2.  Both  inner 
and  outer  arrays  require  eight  runs.  The  total  number  of  runs  is  sixty-four. 
There  is  no  confounding  structure  crossing  the  design  factors  and  the  en- 
vironment factors.  All  cross  interactions  (design x environment  interactions) 
can  be  estimated.  But  no  main  effects  of  design  factors  can  be  obtained 
unless  some  of  the  design x design  interactions  are  assumed  to  be  zeros. 

If  we  replace  the  inner  array  by  a  sixteen-run  resolution  IV  design,  the 
total  number  of  the  cross  design  increases  to  128.  The  inner  array  is  a  2jy 
design  with  generators  E  =  ABC  and  F  =  BCD.  Main  control  effects  are 
free  of  confounding  of  interactions.  All  design x environment  interactions,  as 
w^ell  as  all  main  effects  of  design  factors,  can  be  estimated  in  the  new  cross- 
array  design. 


As  mentioned  before,  main  and  interaction  effects  among  environment 
factors  are  uncontrollable.  They  are  of  less  interest  in  our  special  robust 
issue  context.  Therefore,  we  may  use  a  resolution  III  design  as  the  outer  ar- 
ray. Suppose  that  the  outer  array  is  of  resolution  III.  In  general,  if  an  inner 
array  has  resolution  III,  the  cross-array  design  only  provides  the  estimates 
of  design  X  environment  interactions.  If  an  inner  array  has  resolution  IV,  the 
cross-array  design  can  be  used  to  estimate  design  x  environment  interactions 
and  main  design  factor  effects.  The  proof  of  this  general  result  about  cross- 
array  design  is  in  Appendix  I. 

We  can  see  from  the  above  discussion  that  two  measurements  may  be 
conducted  from  Taguchi's  cross-array  designs.  One  is  Taguchi's  SN  ratio  and 
another  one  is  design  x  environment  interactions.  In  Taguchi's  design  anal- 
ysis, design  X  environment  interactions  are  not  considered.  The  estimation 
of  design  X  environment  interactions  however,  is  sometimes  more  informative 
and  provides  better  understanding  of  the  system  than  SN  ratio. 

2.2     The  Total  Number  of  Runs  Required  in  the  Cross- 
Array  Design 

To  decide  the  total  number  of  runs  in  a  cross-array  design  for  different  set- 
tings, we  must  first  give  a  brief  review  of  minimum  runs  for  resolution  III 
and  IV  designs. 

P-B  design  ■^  is  saturated  orthogonal  design.  However,  it  only  exists  when 
the  number  of  factors  is  a  module  of  four.  When  the  number  of  factors  in- 
vestigated is  not  a  module  of  four,  we  use  a  larger  available  P-B  design.  The 
minimum  number  of  runs  required  for  n  factor  resolution  IV  designs  is  2n 


P-B  designs  are  obtained  by  selecting  a  subset  of  factor  combinations  from  complete 
factorial  designs.  The  construction  of  P-B  designs  is  based  on  the  Hadamard  matrices 
that  exist  if  the  number  of  factors  is  a  module  of  four  {Hedayat  A.  and  W.D.  Wallis(1978), 
"Hadamard  matrices  and  their  application."  The  Annals  of  Statistics.  6,  1184-1238). 
Nongeometric  properties  of  P-B  designs  cause  very  complicated  confounding  structures. 

In  contrast  to  P-B  designs.  2"^/'  fractional  factorial  designs  with  a  run  size  of  power 
two  are  not.  in  general,  saturated  designs.  However.  2"^/  fractional  factorial  designs 
have  simpler  confounding  structures  among  main  and  interaction  effects,  which  provide 
attractive  projection  properties. 


Table  3:   Minimum  Number  of  Experimental  Runs  Required  in  Orthogonal 
Designs 


Number  of  Factors 

Resolution  III' 

Resolution  IV^ 

4 

8 

8 

5 

8 

16 

6 

8 

16 

7 

8 

16 

8 

12 

16 

9 

12 

24 

10 

12 

24 

11 

12 

24 

12 

16 

24 

13 

16 

32 

14 

16 

32 

15 

16 

32 

1.  Fractional  factorial  designs  with  a  run  size  of  power  two  require  more  runs  when  the 
number  of  factors  is  more  than  7. 

2.  Fractional  factorial  designs  with  a  run  size  of  power  two  require  more  runs  when  the 
number  of  factors  is  more  than  8. 


(Webb  (1968)).  A  minimal  resolution  IV  design  can  be  obtained  by  folding 
over  a  resolution  III  design  (Box  and  Wilson  (1951)).  Margolin  (1969)  proved 
that  all  minimal  resolution  IV  designs  must  be  fold-overs.  The  minimal  num- 
ber of  runs  required  in  orthogonal  fractional  factorial  resolution  III  and  IV 
designs  are  shown  in  Table  3. 

To  determine  the  number  of  runs  in  cross-array  design,  one  needs  only  to 
get  the  appropriate  inner  and  outer  sizes  from  Table  3.  The  total  number  of 
required  runs  is  the  product  of  sizes  of  inner  and  outer  arrays. 


Example  3:  Consider  an  example  with  six  design  factors  and  five  environ- 
ment factors.  Because  we  are  not  interested  in  main  effects  and  interactions 
among  environment  factors,  we  can  use  resolution  III  design  in  the  outer  ar- 
ray. The  size  of  the  outer  array  is  eight.  Two  cases  are  considered  separately. 
Case  1:  We  are  only  interested  in  design x environment  interactions.  The  res- 
olution III  design  can  be  used  to  construct  the  inner  array,  which  has  eight 


runs.  The  total  number  of  runs  is  sixty-four.  Case  2:  We  are  interested  in 
design  X  environment  interactions  and  main  design  factor  effects.  In  this  case, 
a  resolution  IV  design  for  the  inner  array  is  required.  A  minimum  resolution 
IV  design  for  six  factors  requires  sixteen  runs.  The  total  number  of  runs  in 
this  cross-array  design  is  128. 

It  is  clear  to  see  that  in  case  2,  the  number  of  runs  for  a  large-scale  system 
can  be  quite  high.  In  the  next  section,  we  introduce  and  implement  block 
cross-array  approach  to  construct  the  desired  class  of  designs,  in  which  the 
experimental  work  is  significantly  reduced,  especially  for  the  system  with  a 
large  number  of  design  factors. 


3     Block  Cross- Array  Approach 

3.1      A  Demonstration  Example 

We  first  use  a  simple  example  to  illistrate  the  idea  of  the  block  cross-array 
approach. 

Example  4:  Suppose  that  there  are  three  design  factors  and  two  envi- 
ronment factors.  Letters  A,  B,  and  C  refer  to  design  factors.  E  and  F 
refer  to  environment  factors.  As  discussed  in  the  previous  section,  in  order 
to  obtain  an  unbiased  estimation  of  the  main  effects  of  design  factors  and 
design  X  environment  interactions,  the  inner  array  should  be  at  least  resolu- 
tion IV  and  the  outer  array  can  be  resolution  111.  Thus  a  total  of  thirty-two 
runs  is  needed  in  the  cross- array  design  to  estimate  all  three  main  design  ef- 
fects and  six  design  x  environment  interactions.  If  we  use  resolution  III  design 
in  both  the  inner  and  outer  arrays,  only  design x environment  interactions  can 
be  estimated.  In  this  case,  both  inner  and  outer  arrays  require  four  runs  and 
the  cross-array  consists  of  sixteen  runs.  Inner  and  outer  arrays  are  in  Table  4. 

Let  us  introduce  some  notations.    Denote  the  column  vector  associated 
with  any  factor,  say  factor  A.  as  A.  Define  -I- .4  =  .4  and  —A  be  the  vector 


Table  4:  2, r/  Inner  and  2^  Outer  Arrays  (Example  4) 


A 

B 

C= 

=AB 

D 

E 

+ 

+ 

+ 

+ 

+ 

+ 

- 

- 

+ 

- 

- 

+ 

- 

- 

+ 

— 

— 

+ 

— 

- 

that  all  signs  are  revised  in  A.  That  is, 


A  = 


-A 


(  +  \ 

+ 


\-  J 


+ 


Also  define  /  be  the  vector  of  all  elements  +.  Then  —/is  the  vector  of 
all  elements  — .  Then  the  cross-array  design  for  five  factors  A,  B,  C,  D,  and 
E  is  in  Table  5.  We  call  this  cross-array  simple  cross-array. 

Example  5:  To  describe  the  block  fractional  factorial  technique,  let  us  first 
construct  a  three-factor  resolution  III  design  2;7/.  Assign  C,  D  and  E  (not 
only  D  and  E  )  to  the  three  columns  as  shown  in  Table  6.  This  resolution 
III  design  is  related  to  the  outer  array  for  the  environment  factors  E  and  F. 
But  the  design  has  one  more  column  for  the  assignment  of  one  design  factor, 
say.  design  factor  C.  in  our  example. 

Next  construct  a  resolution  111  (  not  resolution  IV  !)  inner  array  for  design 
factors  A.  B.  and  C.  as  in  Table  7. 

Obtain  the  cross-array  for  five  factors  A.  B.  C.  D.  E.  shown  in  Table 
8.    We  call  this  cross-array  block  cross-arr^ay.    The  only  difference  between 
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Table  5:  Simple  Cross-Array  (Example  4) 
A       B       C       D     E 


+/ 

+/ 

+/ 

D 

E 

+/ 

-/ 

-/ 

D 

E 

-/ 

+/ 

-/ 

D 

E 

-/ 

-/ 

+/ 

D 

E 

Table  6:  2jjj  for  Outer  Array  (Example  5) 


C  D  E=CD 

+  +  + 

+  -  - 

-  +  - 

-  -  + 


Table  7:  2m  for  Inner  Array  (Example  5) 


A  B  C=AB 

+  +  + 

+  -  - 

-  +  - 

-  -  + 
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Table  8:  Block  Cross-Array  (Example  5) 
ABC  D     E 

+7  +7  +C^  £  £_ 

+7  -/  -C  D  E 

-I_  +1  -C_  D  E 

-7  -I  +C  D  E 

1.  C  is  the  vector  corresponding  to  factor  C  in  the  outer  array  (Table  6). 


this  block  cross-array  and  the  simple  cross-array  in  Table  5  is  the  blocks 
corresponding  t'  the  design  factor  <^.  In  the  simple  cross-array,  the  four 
small  blocks  corresponding  to  the  factor  C  is  either  7  o£  -7.  For  the  block 
cross-array,  the  level  arrangement  of  the  small  block  C  is  from  the  outer 
array  in  Table  6.  The  signs  before  the  fom:  small  blocks  of  C  come  from 
the  settings  of  factor  C  in  the  inner  array  (Table  7).  Two  cross-arrays  in 
Table  5  and  Table  8  have  the  same  number  of  runs.  But  the  main  design 
effects  are  confounded  with  design  x  design  interactions  in  the  simple  cross- 
array.  However,  main  design  effects  are  not  confounded  with  design  x  design 
interactions  in  the  block  cross-array.  Thus,  we  combine  two  resolution  III 
arrays  (in  Table  6  and  Table  7)  to  get  a  cross-array  that  provides  unbiased 
estimation  of  design  x  environment  interactions  as  well  as  main  design  effects 
free  from  design x design  interactions.  The  level  settings  of  the  block  cross- 
array  are  given  in  Table  9.  It  is  easy  to  check  that  the  block  cross-array  has 
the  desired  property  (in  fact,  this  is  a  resolution  V  design). 

3.2     Block  Cross-Array  Approach:  Run  Savings 

The  result  demonstrated  in  the  above  five  factor  design  can  be  extended  to 
the  general  case. 

Suppose  that  there  are  n  design  factors  and  m  environment  factors.  The 
step  by  step  procedure  for  the  construction  of  a  block  cross  design  is  as  fol- 
lows: 
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Table  9:  Level  Arrangement  in  Block  Cross-Array  (Example  5) 

A     B     C     D     E 


+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

- 

- 

+ 

+ 

- 

+ 

- 

+ 

+ 

— 

— 

+ 

+ 
+ 
+ 

- 

- 

+ 

+ 

— 

+ 

+ 

— 

+ 

- 

+ 

— 

+ 

_ 

+ 

— 

+ 

+ 

- 

+ 

- 

- 

- 

- 

+ 

+ 

+ 

- 

— 

+ 

+ 

— 

+ 

_ 

— 

+ 

+ 

+ 

- 

- 

+ 

- 

- 

_ 

— 

— 

+ 

— 

+ 
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1.  Choose  the  maximal  possible  integer  p  and  construct  a  resolution  III 
design  2"7/  for  n  design  factors.  Denote  this  design  matrix  as  X. 

2.  If  the  design  obtained  in  Step  1  has  resolution  IV  or  higher  ^.  construct 
a  resolution  III  design  for  m  environment  factors.  Otherwise,  construct  a 
resolution  III  design  for  m+1  factors  "*.  Denote  the  design  matrix  as  Z. 

3.  Obtain  the  block  cross-axray  for  these  n+m  factors. 

Case  1.  The  design  obtained  in  Step  1  has  resolution  IV  or  higher.  In  this 
case,  the  block  cross-array  is  exactly  same  as  simple  cross-array  and  there  is 
no  run  saving. 

Case  2.  There  exists  a  resolution  III  design  2"//  for  some  p  in  Step  1.  As- 
sume q  factors  can  be  accommodated  in  this  2""^-run  design  such  that  the 
design  for  these  q  factors  is  of  resolution  IV  or  higher  ^.  Assume  the  first  q 
columns  in  X  are  corresponding  to  these  q  factors.  In  this  case,  assign  the 
first  q  design  factors  to  the  small  block  /  with  signs  corresponding  to  the 
first  q  columns  of  X;  assign  the  remaining  n-q  design  factors  with  the  small 
block  obtained  from  the  first  column  of  Z  with  the  signs  corresponding  to 
the  last  n-q  columns  of  X:  finally,  assign  m  environment  factors  to  the  last 
m  columns  of  Z. 

We  use  two  examples  to  illustrate  the  above  general  procedure. 

Example  6:  Consider  six  design  factors  and  six  environment  factors:  that 
is,  n=6  and  m=6.  Let  A,  B,  C,  D.  E  and  F  refer  to  six  design  factors  and 
G.  H.  J.  K.  L  and  M  refer  to  six  environment  factors.  There  exists  a  res- 
olution 2;7/  design  (p=3)  for  six  design  factors.  The  maximal  integer  q  is 
four  {q  =  4)  in  this  example:  that  is.  if  we  only  consider  factors  A,  B,  C  and 
D.  the  design  is  of  resolution  IV.  The  design  matrix  of  X  is  given  in  Table 
10.  Because  there  exists  a  resolution  III  design  2;7/.  we  need  to  construct 
a  resolution  III  design  for  seven  (m-hl=7)  factors.  We  use  a  eight  run  P-B 
design  and  get  the  design  matrix  Z.  Let  i?  be  the  first  column  of  Z  and  G. 


''There  does  not  exist  resolution  III  designs  for  certain  number  of  factors,  such  as  one. 
two,  four  and  eight. 

"'The  design  in  Step  2  may  not  have  a  run  size  of  power  two.  For  example,  we  may  use 
P-B  designs. 

"^It  is  clear  that  q  >  n-p  or  n-q  <  p. 
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Table  10:  2^7/  Array  X  (Example  6) 


A 

B 

C 

D 

+ 

+ 

+ 

+ 

+ 

+ 

- 

- 

- 

+ 

+ 

- 

+ 

- 

+ 

- 

+ 

- 

- 

+ 

- 

- 

+ 

+ 

— 

+ 

— 

+ 

D=ABC     E=AB     F=AC 

+  + 


+ 


+ 


+ 


+ 
+  + 


Table  11:  Block  Cross- A.ray  (Example  6) 
ABCDE         F         GHJKLM 


+7 

+7 

+1 

+7 

+7? 

+R 

G 

H 

J 

K 

L 

a7 

+/ 

+7 

-I 

-I 

+7? 

-R 

G 

H 

J 

K 

L 

M 

-/ 

+7 

+1 

-7 

-7? 

-R 

G 

H 

J 

K 

L 

A7 

+/ 

-7 

+1 

-7 

-7? 

+R 

G 

H 

J 

K 

L 

M 

+7 

-7 

-I 

+7 

-R 

-R 

G 

H 

J 

K 

L 

M 

-7 

-7 

+7 

+7 

+R 

-R 

G 

H 

J 

K 

L 

M 

-7 

+1 

-7 

+7 

-R 

+R 

G 

H 

J 

K 

L 

M 

....  M  are  the  columns  corresponding  to  factors  G.  ....  M  in  Z.  respectively. 
The  total  number  of  runs  in  the  block  cross-array  is  sixty- four  (8x8).  The 
block  cross  design  matrix  is  given  in  Table  11. 

Example  7:  Consider  thirteen  design  factors  and  two  environment  fac- 
tors: that  is.  n=13  and  m=2.  Let  A.  B.  C.  D.  E.  F.  G.  H.  J.  K.  L.  M  and  N 
refer  to  eleven  design  factors  and  0  and  P  refer  to  two  environment  factors. 
There  exists  a  resolution  2};7^  design  (p  =  9)  for  thirteen  design  factors. 
In  this  example,  q  =  9.  The  design  matrix  of  X  is  given  in  Table  12.  Be- 
cause there  exists  a  resolution  III  design  2};7'^  for  design  factors,  we  need  to 
construct  a  resolution  III  design  ^or  three  (m+l=3)  factors.   We  use  a  2^7; 
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Table  12:  2]]f  Array  X  (Example  7) 


A 

B 

C 

D 

E=ABC 

F=ABD 

G=ACD 

H=BCD 

J  = 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

- 

+ 

- 

+ 

- 

- 

- 

— 

+ 

+ 

+ 

- 

— 

- 

+ 

— 

+ 

- 

+ 

+ 

- 

- 

+ 

- 

- 

+ 

— 

— 

+ 

+ 

- 

- 

+ 

+ 

- 

- 

+ 

+ 

+ 

+ 

- 

- 

+ 

— 

+ 

— 

+ 

+ 

- 

+ 

— 

+ 

- 

- 

- 

+ 

- 

+ 

+ 

+ 

- 

+ 

+ 

+ 

- 

+ 

- 

- 

- 

- 

+ 

+ 

— 

— 

— 

— 

+ 

+ 

+ 

- 

+ 

+ 

- 

- 

+ 

+ 

- 

+ 

+ 

— 

+ 

— 

- 

+ 

— 

+ 

+ 

+ 

- 

- 

- 

- 

+ 

+ 

- 

- 

- 

- 

+ 

- 

+ 

- 

+ 

+ 

- 

- 

+ 

- 

- 

+ 

+ 

- 

+ 

- 

:ABCD         K  =  AB         L=AC         M=AD         N  =  BC 

+  +  +  + 

+  -  +  - 

-  -  -  + 

-  +  +  - 

-  -  +  + 
+  -  -  - 

-  +  -  - 
+  +  -  + 
+  +  -  + 
+  -  -  - 

-  -  +  + 

-  +  -  - 

-  -  -  + 
+  -  +  - 

-  +  +  - 
+  +  +  + 


design  and  get  the  design  matrix  Z.  Let  R  be  the  first  column  of  Z  and  O, 
P  are  the  columns  corresponding  to  factors  O  and  P  in  Z,  respectively.  The 
total  number  of  runs  in  the  block  cross-array  is  sixty-four  (16x4).  The  block 
cross  design  matrix  is  given  in  Table  13. 


Table  14  lists  the  results  up  to  fifteen  design  and  fifteen  environment  fac- 
tors. The  argument  in  Example  6  and  7  can  be  easily  extended  to  the  general 
block  cross-array  cases.  The  proof  is  in  Appendix  II. 
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Table  13:  Block  Cross-Array  (Example  7) 
BCDEFGHJ        K        L         MN        OP 


+/ 

+/ 

+/ 

+7 

+7 

+7 

+7 

+7 

+7 

+7? 

+R 

+R 

+R 

O 

P 

+/ 

+/ 

-/ 

+7 

-7 

+7 

-7 

-7 

-7 

+7? 

-R 

+R 

-R 

O 

P 

-/ 

+/ 

+/ 

+1 

-7 

-7 

-7 

+7 

-7 

-7? 

-R 

-7? 

+R 

0 

P 

+/ 

-/ 

+/ 

+1 

-7 

-7 

+7 

-7 

-7 

-7? 

+R 

+7? 

-7? 

O 

P 

+/ 

-/ 

-/ 

+7 

+7 

-7 

-7 

+7 

+7 

-7? 

-R 

+7? 

+7? 

0 

P 

-/ 

-/ 

+/ 

+7 

+7 

+7 

-7 

-7 

+7 

+7? 

-R 

-7? 

-7? 

O 

P 

-/ 

+/ 

-/ 

+7 

+7 

-7 

+7 

-7 

+7 

-7? 

+R 

-7? 

-7? 

O 

P 

-/ 

-/ 

-7 

+7 

-7 

+7 

+7 

+7 

-7 

+7? 

+R 

-7? 

+7? 

O 

P 

+/ 

+/ 

+/ 

-7 

+7 

-7 

-7 

-7 

-7 

+7? 

+R 

-R 

+R 

O 

P 

+/ 

+/ 

-/ 

-7 

-7 

-7 

+7 

+7 

+1 

+7? 

-R 

-R 

-R 

O 

P 

-/ 

+/ 

+1 

-7 

-7 

+  7 

+7 

-7 

+1 

-7? 

-R 

+R 

+R 

O 

P 

+/ 

-/ 

+1 

-7 

-7 

+  7 

-7 

+  7 

+7 

-R 

+R 

~R 

-R 

O 

P 

+/ 

-/ 

-I 

-7 

+7 

+7 

+7 

-7 

-7 

-R 

-R 

-R 

+R 

O 

P 

-/ 

-/ 

+1 

-7 

+7 

-7 

+7 

+7 

-7 

+R 

-R 

+R 

-R 

O 

P 

-/ 

+/ 

-I 

-7 

+7 

+7 

-7 

+7 

-7 

-R 

+R 

+R 

-R 

O 

P 

16 


4     Discussion 

The  motivation  behind  our  work  is  to  use  robust  designs  to  screen  a  large 
number  of  design  factors.  In  order  to  estimate  main  design  effects  free  of 
confounding  with  interactions,  a  simple  cross-array  requires  a  resolution  IV 
design  as  an  inner  array.  For  a  large  number  of  design  factors,  the  number  of 
runs  in  the  simple  cross-array  is  quite  high  and  very  costly.  The  block  cross- 
array  design  combines  two  resolution  III  designs  to  reduce  the  experimental 
runs. 

There  is  another  possible  application  of  the  block  cross-array  design.  It  is 
useful  if  investigators  are  interested  in  finding  the  best  settings  of  design  fac- 
tors such  that  the  variation  caused  by  environment  change  is  minimum.  Rox . 
and  Jones  (1990)  proved  that  to  achieve  minimum  variation  one  needs  only 
to  know  the  main  and  interaction  effects  among  environment  factors.  If  we 
assign  environment  factors  in  the  inner  array  and  design  factors  in  the  outer 
array  in  our  proposed  block  cross-array  designs,  main  environment  effects 
and  design  X environment  interactions  can  be  estimated.  Box  and  Jones  used 
single  arrays  to  construct  appropriate  designs  for  some  certain  combinations 
of  the  numbers  of  design  and  environment  factors.  The  single  array  approach 
is  supposed  to  use  less  runs  and  to  be  superior  to  the  Taguchi  cross-array 
method.  For  some  combinations  of  the  numbers  of  design  and  environment 
factors,  there  is  no  easy  way  to  get  efficient  desired  designs.  In  this  case, 
one  must  use  a  larger  size  design  that  is  available.  For  example,  it  requires 
sixty-four  runs  to  investigate  eleven  design  and  three  environment  factors. 
But  it  requires  the  same  number  of  runs  for  nine  or  ten  design  factors  and 
three  environment  factors  (Box  and  Jones  (1990b),  pp.  41).  Compared  to 
sixty-four  runs,  our  block  cross  designs  need  only  forty-eight  runs  for  nine 
or  ten  design  factors  and  three  environment  factors.  In  the  cases  that  there 
are  single  array  designs  available,  the  number  of  runs  required  in  the  block 
cross-array  designs  are  equal  to  or  less  than  those  given  in  Box  and  Jones' 
work  (see  Table  14). 

As  a  final  point,  the  result  can  be  extended  to  three-  or  mixed-level  designs 
to  detect  the  curvature  and  cross-interactions  among  design  factors. 
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Table  14:  Number  of  Runs  in  Block  Cross-Array  Design(BCAD)  and  Single 
Array  Design(SAD) 


Number  of 

Number  of 

Number  of 

Number  of 

Number 

of 

Number  of 

Design  Factors 

Envir.   Factors 

Runs  in  X 

Runs  in  Z 

Runs  in 

BCAD 

Runs  in  SAD^ 

1 

2 

2 

4 

4 

2 

2 

3 

8 

8 

3 

2 

3 

8 

8 

4 

2 

8 

16 

16 

5 

2 

8 

16 

16 

6 

2 

8 

16 

16 

7 

2 

8 

16 

16 

8 

2 

12 

24 

32 

9 

2 

12 

24 

32 

10 

2 

12 

24 

32 

11 

2 

12 

24 

32 

12 

2 

16 

32 

32 

13 

2 

16 

32 

32 

14 

2 

16 

32 

32 

15 

2 

16 

32 

32 

2 

1 

4 

2 

8 

8 

2 

2 

4 

4 

16 

16 

2 

3 

4 

4 

16 

16 

2 

4 

4 

8 

32 

32 

2 

5 

4 

8 

32 

32 

2 

6 

4 

8 

32 

32 

2 

7 

4 

8 

32 

32 

2 

8 

4 

12 

48 

64 

2 

9 

4 

12 

48 

64 

2 

10 

4 

12 

48 

64 

2 

11 

4 

12 

48 

64 

2 

12 

4 

16 

64 

64 

2 

13 

4 

16 

64 

64 

2 

14 

4 

16 

64 

64 

2 

15 

4 

16 

64 

64 

3 

1 

4 

4 

16 

16 

3 

2 

4 

4 

16 

16 

3 

3 

4 

8 

32 

32 

3 

4 

4 

8 

32 

32 

3 

5 

4 

8 

32 

32 

3 

6 

4 

8 

32 

32 

3 

7 

4 

12 

48 

64 

3 

8 

4 

12 

48 

64 

3 

9 

4 

12 

48 

64 

3 

10 

4 

12 

48 

64 

3 

11 

4 

16 

64 

64 

3 

12 

4 

16 

64 

128 

3 

13 

4 

16 

64 

128 

3 

14 

4 

16 

64 

128 

3 

15 

4 

20 

80 

128 

4 

1 

8 

2 

16 

16 

4 

2 

8 

4 

32 

32 

4 

3 

S 

4 

32 

32 

4 

4 

8 

8 

64 

64 

4 

5 

8 

8 

64 

64 

4 

6 

8 

8 

64 

64 

4 

7 

8 

8 

64 

64 

4 

8 

8 

12 

96 

NA 

4 

9 

8 

12 

96 

NA 

4 

10 

8 

12 

96 

NA 

4 

11 

8 

12 

96 

NA 

4 

12 

8 

16 

128 

NA 

4 

13 

8 

16 

128 

NA 

4 

14 

8 

16 

128 

NA 

4 

15 

8 

16 

128 

NA 

1    The  results  are  based  on  Box  and  Jones  {1991b). 
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Number 

of 

Number  of 

Number  of 

Number  of 

Number  of 

Number  of 

Design  Fact 

ors 

Envir     Factors 

Runs  in  X 

Runs  in  Z 

Runs  in  BCAD 

Runs  in  SAD 

5,6,7 

1 

8 

2 

16 

16 

5,6,7 

2 

8 

4 

32 

32 

5,6,7 

3 

8 

8 

64 

64 

5,6,7 

4 

8 

8 

64 

64 

5,6,7 

5 

8 

8 

64 

64 

5,6,7 

6 

8 

8 

64 

NA 

5,6,7 

7 

8 

12 

96 

NA 

5,6,7 

8 

8 

12 

96 

NA 

5,6,7 

9 

8 

12 

96 

NA 

5,6,7 

10 

8 

12 

96 

NA 

5,6,7 

.    11 

8 

16 

128 

NA 

5,6,7 

■r- 

"  12 

8 

16 

128 

NA 

5,6,7 

13 

8 

16 

128 

NA 

5,6,7 

14 

8 

16 

128 

NA 

5,6,7 

15 

8 

20 

160 

NA 

8,9,10 

1 

16 

2 

32 

32 

8,9,10 

2 

16 

4 

64 

64 

8,9,10 

3 

16 

4 

64 

64 

8,9,10 

4 

16 

8 

64 

NA 

8,9,10 

5 

16 

8 

128 

NA 

8,9,10 

6 

16 

8 

128 

NA 

8,9,10 

7 

16 

8 

128 

NA 

8,9,10 

8 

16 

12 

192 

NA 

8,9,10 

9 

16 

12 

192 

NA 

8,9,10 

10 

16 

12 

192 

NA 

8,9,10 

11 

16 

12 

192 

NA 

8,9,10 

12 

16 

16 

256 

NA 

8,9,10 

13 

16 

16 

256 

NA 

8,9,10 

14 

16 

16 

256 

NA 

8,9,10 

15 

16 

16 

256 

NA 

11,12,13, 

,14, 

15 

1 

16 

2 

32 

NA 

11,12,13, 

14, 

15 

2 

16 

4 

64 

NA 

11.12.13, 

14, 

15 

3 

16 

8 

128 

NA 

11.12.13, 

14, 

15 

4 

16 

8 

128 

NA 

11,12,13. 

14, 

15 

5 

16 

8 

128 

NA 

11,12,13, 

14, 

15 

6 

16 

8 

128 

NA 

11,12,13. 

14, 

,15 

7 

16 

12 

192 

NA 

11,12,13, 

,14, 

,15 

8 

16 

12 

192 

NA 

11,12,13 

,14, 

,15 

9 

16 

12 

192 

NA 

11,12,13 

,14 

,15 

10 

16 

12 

192 

NA 

11,12,13 

,14 

,15 

11 

16 

16 

256 

NA 

11,12,13 

,14 

,15 

12 

16 

16 

256 

NA 

11,12,13 

,14 

,15 

13 

16 

16 

256 

NA 

11,12,13 

,14 

,15 

14 

16 

16 

256 

NA 

11,12,13 

.14 

.15 

15 

16 

20 

320 

NA 
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Appendix  I  :  Estimation  of  Design  x  Environment  Interac- 
tions 

Assumption  (1):  The  expected  response  E{y)  can  be  described  by  the  model 

n  m 

E{y)  =  fi  +  Y^  Oi,x^  +  ^  (5jZj  +  ^  7tjXt2j  +  Y^  ^ikXxXk  +  Y^  VjiZjZi      (1) 

1  =  1  j  =  l  ijtj  l^k  j:^l 

where  /i,  o:,,  /?j,  fij,  6ik  and  rjji  are  general  mean,  design,  environment, 
design X environment,  design x design  and  environment  x environment  effects, 
respectively. 

Assumption  (2):  Let 

^  X  =  [Xi,...,X„] 

and 

Z  =  [Z\,  ...,  Zm\ 

be  inner  and  outer  arrays,  where  vector  Xi  corresponds  to  a^,  and  Zj  corre- 
sponds to  Pj.  All  elements  of  X^  and  Zj  are  two  levels,  either  1  or  -1,  and 
the  number  of  1  and  -1  are  equal  for  each  X,  or  Zj. 

Assumption  (3):  Orthogonality 

XfXj  =  0^ 

and 

ZlZt  =  0 

where  i  ^  j  and  k  ^  I. 

P-B  and  2"/~/  fractional  factorial  designs  satisfy  Assumption  (2)  and  (3). 

Lemma  .  Under  Assumption  (1).  (2).  and  (3). 

(a)  in  the  simple  cross-array  X  x  Z.  design x environment  interactions  7ij  can 
be  estimated. 

(b)  if  design  matrix 

X   =   [X, Xr,] 


^The  product  is  a  common  vector  dot  product.  Xj^  is  the  transposition  of  X,. 
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is  of  resolution  IV,  then  in  the  simple  cross-array  X  x  Z,  design  x environment 
interactions  7ijS,  as  well  as  design  main  effects  ajS  are  estimable. 
Proof. 

If  6ik  —  0  for  all  i  ^  k  and  /;_,/  =  0  for  j  ^  /,  then  a^s  and  7jjS  can  be  esti- 
mated in  the  simple  cross-array  design  X  x  Z.  This  follows  the  properties  of 
the  Kronecker  product  (Shoemaker,  Tsui  and  Wu  (1991)). 
Part  (a).  In  order  to  show  that  7ijS  can  be  estimated,  we  need  only  to 
check  that  the  columns  corresponding  to  7,^  and  6ki  are  orthogonal,  and  the 
columns  corresponding  to  7ij  and  rjki  are  orthogonal  m  X  x  Z.  They  are  true 
because  of  Assumption  (2). 

Part  (b).  We  need  only  to  check  furtherthat  the  columns  corresponding  to 
cti  and  6-jk  are  orthogonal,  and  the  columns  corresponding  to  Qj  and  r/jfc  are 
orthogonal.  The  columns  corresponding  to  q,  and  6jk  are  orthogonal  because 
X  is  of  resolution  IV.  The  columns  corresponding  to  ai  and  r/j/t  are  orthogo- 
nal because  of  Assumption  (2). 


Appendix  II:  Block  Cross-Array  Designs 

Under  the  Assumption  (1),  (2),  abd  (3)  in  Appendix  I, 
Case  1:  if  the  design  obtained  in  Step  1  has  resolution  IV  or  higher,  the  block 
cross-array  design  is  the  same  as  the  simple  cross-array  design.  The  proof  is 
given  in  Appendix  I  (b). 

Case  2:  there  exists  a  resolution  III  design  2"//  for  some  p  in  Step  1.  Sup- 
pose that  q  factors  X\.  ....  Xq  can  be  accommodated  in  this  2"~''-run  design 
such  that  the  design  for  these  q  factors  is  of  resolution  IV  or  higher.  In  XxZ, 
the  only  difference  from  simple  cross-array  design  is  the  settings  of  other  n-q 
design  factors,  X,+i,  ...,  X„.  In  the  block  cross-array,  we  use  the  first  column 
R  in  Z  instead  of  I  in  the  simple  cross-array.  However,  R  is  orthogonal  to  all 
other  columns  in  Z.  Hence,  one  can  easily  check  that  all  steps  in  Appendix  1 
are  valid  in  the  block  cross-arrav  case. 
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